initial experiment
Automated Aircraft Recovery via Reinforcement Learning: Initial Experiments
Initial experiments described here were directed toward using reinforce(cid:173) ment learning (RL) to develop an automated recovery system (ARS) for high-agility aircraft. An ARS is an outer-loop flight-control system de(cid:173) signed to bring an aircraft from a range of out-of-control states to straight(cid:173) and-level flight in minimum time while satisfying physical and phys(cid:173) iological constraints. Here we report on results for a simple version of the problem involving only single-axis (pitch) simulated recoveries. Through simulated control experience using a medium-fidelity aircraft simulation, the RL system approximates an optimal policy for pitch-stick inputs to produce minimum-time transitions to straight-and-Ievel flight in unconstrained cases while avoiding ground-strike. The RL system was also able to adhere to a pilot-station acceleration constraint while execut(cid:173) ing simulated recoveries.
A first taste of Codex
One of the highlights of my technical life in 2020 was getting access to GPT-3. Thanks to the advice provided by in this video, I was able to get access to GPT-3 and publish a series of videos describing experiments I did with GPT-3 to generate git commands from English, to create a movie trivia chatbot, and to navigate the London Underground and the New York City subway. I was impressed with the variety of problems that GPT-3 could tackle, so when I heard about Codex I was anxious to try it out. Codex focused on one of the capabilities of GPT-3, generating code from English language descriptions. Codex generates code in a variety of languages, including Python and JavaScript.
- North America > United States > New York (0.26)
- Europe > United Kingdom > England > Greater London > London (0.26)
- North America > Canada (0.10)
Improving Transfer Rates in Brain Computer Interfacing: A Case Study
Meinicke, Peter, Kaper, Matthias, Hoppe, Florian, Heumann, Manfred, Ritter, Helge
We adopted an approach of Farwell & Donchin [4], which we tried to improve in several aspects. The main objective was to improve the transfer rates based on offline analysis of EEGdata but within a more realistic setup closer to an online realization than in the original studies. The objective was achieved along two different tracks: on the one hand we used state-of-the-art machine learning techniques for signal classification and on the other hand we augmented the data space by using more electrodes for the interface. For the classification task we utilized SVMs and, as motivated by recent findings on the learning of discriminative densities, we accumulated the values of the classification function in order to combine several classifications, which finally lead to significantly improved rates as compared with techniques applied in the original work. In combination with the data space augmentation, we achieved competitive transfer rates at an average of 50.5 bits/min and with a maximum of 84.7 bits/min.
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.05)
- North America > United States > Virginia > Arlington County > Arlington (0.04)
- North America > United States > New York (0.04)
- (2 more...)
Improving Transfer Rates in Brain Computer Interfacing: A Case Study
Meinicke, Peter, Kaper, Matthias, Hoppe, Florian, Heumann, Manfred, Ritter, Helge
We adopted an approach of Farwell & Donchin [4], which we tried to improve in several aspects. The main objective was to improve the transfer rates based on offline analysis of EEGdata but within a more realistic setup closer to an online realization than in the original studies. The objective was achieved along two different tracks: on the one hand we used state-of-the-art machine learning techniques for signal classification and on the other hand we augmented the data space by using more electrodes for the interface. For the classification task we utilized SVMs and, as motivated by recent findings on the learning of discriminative densities, we accumulated the values of the classification function in order to combine several classifications, which finally lead to significantly improved rates as compared with techniques applied in the original work. In combination with the data space augmentation, we achieved competitive transfer rates at an average of 50.5 bits/min and with a maximum of 84.7 bits/min.
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.05)
- North America > United States > Virginia > Arlington County > Arlington (0.04)
- North America > United States > New York (0.04)
- (2 more...)
Improving Transfer Rates in Brain Computer Interfacing: A Case Study
Meinicke, Peter, Kaper, Matthias, Hoppe, Florian, Heumann, Manfred, Ritter, Helge
We adopted an approach of Farwell & Donchin [4], which we tried to improve in several aspects. The main objective was to improve the transfer ratesbased on offline analysis of EEGdata but within a more realistic setup closer to an online realization than in the original studies. The objective wasachieved along two different tracks: on the one hand we used state-of-the-art machine learning techniques for signal classification and on the other hand we augmented the data space by using more electrodes for the interface. For the classification task we utilized SVMs and, as motivated byrecent findings on the learning of discriminative densities, we accumulated the values of the classification function in order to combine several classifications, which finally lead to significantly improved rates as compared with techniques applied in the original work. In combination withthe data space augmentation, we achieved competitive transfer rates at an average of 50.5 bits/min and with a maximum of 84.7 bits/min.
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.05)
- North America > United States > Virginia > Arlington County > Arlington (0.04)
- North America > United States > New York (0.04)
- (2 more...)